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Abstract 

In this paper, we calculate energy required to copy one bit of useful informa- 
tion in the presence of thermal noise. For this purpose, we consider a quantum 
system capable of storing one bit of classical information, which is initially in a 
mixed state corresponding to temperature T. We calculate how many of these 
systems must be used to store useful information and control bits protecting the 
content against transmission errors. Finally, we analyze how adding these extra 
bits changes the total energy consumed during the copying. 



1 Introduction - Landauer principle 



^ , What is the relationship between information and heat (energy)? Does a machine that 

' performs calculations (such as a computer) have to produce heat? These questions are 

, purely fundamental but they are also important from a technical point of view. Firstly, 

' as computer users, we want to pay less for the electricity we consume. Secondly, the 

, problem of cooling modern electronic systems with high packing density of components 

' is a great challenge for engineers. 

, The relationship between heat Q (and the thermodynamic entropy S) and informa- 

tion had occupied the attention of researchers for a long time before the invention of 
the computer. Let us recall here the problem of Maxwell's demon separating faster 
L ^ ■ particles from the slower which resulted in the flow of heat from a colder to a hot- 

rS \ ter reservoir. These considerations led to the suggestion that the measure (gain of 

' information) always requires the increase of thermodynamic entropy [1], [2]. 

According to the present state of knowledge, information processing (calculations) may 
take place without the production of heat. In this case, we are talking about reversible 
computations. The main feature of reversible computations is the ability to recover 
input data based on output data. The machine fully capable of implementing this type 
of task would be a quantum computer [3] , [4] . 

However, the modern digital machine is not reversible. Moreover, apart from the 
calculations, it must perform other functions (associated with the calculations) as 
well as reading of data, copying of data, etc.. In 1961, Rolf Landauer showed in his 
work [5] that any logically irreversible manipulation of information, such as erasing the 
information, must result in an increase in entropy of the apparatus or the environment. 
Erasing one bit of information should result in the production of heat at the order of 
kT\n2. This is often called the "Landauer principle". 

The present paper relates to those considerations, but it does not recalculate the 
Landauer's result using a different method. In our work, we consider another (though 
related) issue. We wonder how much energy should be used to make a copy of one 
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bit useful information when we do not have a pure medium on which we could save a 
copy, that is, if there is a necessity, to overwrite the original thermal noise appearing 
on the medium. Therefore, we assume that information is protected against errors 
due to thermal noise by the presence of additional control symbols (redundancy). We 
investigate whether it is better to use a small number of control symbols with a greater 
energy expenditure per bit (higher signal to noise ratio) or the other way round (ie. 
use a large number of control symbols at low signal to noise ratio). For this purpose, 
we introduce the concept of quantum copier that makes copies of information between 
subsystems. The main result of the work (presented in the last section) is limitation 
for the minimum energy required to copy one bit similar to Landauer's one. 



2 Quantum copier 

Consider a physical (quantum) system that stores one bit of classical information. Let 
logic state "0" correspond to the quantum state |0) and logic state "1" correspond 
to the quantum state States |0) and |1) are orthogonal to each other (which 
ensures their distinguishability in the measurement), normalized and form the basis of 
a quantum system. 

Let us consider two such systems which will be called A and B, respectively. Next, we 
construct a quantum operation that copies the states "0" and "1" from the system A 
to system B according to the following scheme: 

|0)A|pm)B ^ \0)a\0)b (1) 
|l)^|pm)B ^ \1)a\1)b (2) 

where the state Ipm)^ means a given state of the system B. As we shall see, copy 
could be done properly only if the system B is initially in a particular state, which 
here is denoted by the abbreviation "pm", which stands for "pure medium". 
The choice of states |0) and |1) as basis vectors (and not as some combination of the 
basis states) is only a simplification of the notation does not restrict the generality of 
our considerations. 

In order to fully determine the unitary operation acting on subsystems A and B we 
have to introduce vector |um)B (from the words "unprepared medium") orthogonal to 
Ipni)^ and determine the action of the operation on it. If we did it as followo 

|0)|um)^|0)|0) 
|l)|um)^|l)|l) 

then our operation would be able to copy the initial state of subsystem A to subsystem 
B, regardless of the initial state of medium B. Unfortunately, this type of operation 
is not unitary. This would be an irreversible process erasing information about the 
initial state of B. Thus, we have to design our system as follows: 

|0)|um)^|0)|l) (3) 
|l)|um)^|l)|0) (4) 

This means that for copying operation (which will be called the quantum copier) to 
work correctly, the second entry must always be in the state |pm). Otherwise errors 
will occur. 

Equations (l)-(4) fully define the operation of the copier as a unitary operation acting 
over Ha®Hb- Let us emphasize that the copier can copy only the base states (|0)a and 
|1)a), not their superpositions. Copying of any state is impossible by the no-cloning 
theorem. 

^ In the further part of the work, we will use shorter notation of states (i.e. without lower indices 

A, and B). States |0)a|1>s will be denoted by |0)|1> or oven |01). 
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3 Copy to the unprepared medium (in the presence 
of noise) 

Let us examine what the result of copying will be when the medium B is initially 
unprepared. For this purpose, we choose the initial state of B as a mixed state in the 
form: 

ps = (1 — 6)|pm)(pm| + 6|um)(um| (5) 

where b can be identified with a probability of incorrect preparation of the medium 
(and therefore erroneous copying). 

In the case of A, wc assume that with probability po the system stores a "0" , and with 
probability of pi it stores a " 1" . Therefore, we assign the system A a mixed state in 
the following form: 

PA=Po\0){0\+pi\l){l\ (6) 
Subsystems A and B are together in a state which can be written as: 

PAB = pA®pB=Po{l - 6)|0)|pm)(pm|(0| +po&|0)|um)(um|(0| + 

+ - 6)|l)|pm)(pmKl| +pi6|l)um)(umKl| (7) 

After copying information (after applying the unitary operation Uc described by the 
equations (l)-(4)) we obtain: 

p'j,s = UcPabU+ =po|0)(OU[(1 - 6)|0)(0|s + 6|1)(1|b]+ 

+ Pi|1)(1U[(1-6)|1)(1|b+6|0)(0|b] (8) 

and after counting the partial trace: 



p'a = Po|0)(0|+pi|l)(l| (9) 

p's = [po(l-6)+Pi6]|0)(0| + [po6 + Pi(l-6)]|l)(l| (10) 

Let us look at specific cases: 

p'b = po|0)(0|+pi|l)(l| for & = (11) 

p'b = ||0)(0| + i|l)(l| for &=i (12) 

p's = pi|0)(0|+po|l)(l| for 6=1 (13) 



Thus, we have obtained what we expected. For 6 = we obtain a faithful copy, for 
6 = 5 we obtain a complete lack of information copied from A to B, for b = 1 we get 
a faithful copy with negation (the states |pm)B and lum)^ turn its roles). 

4 Relationship with Shannon's binary information 
channel 

Wc will treat states of ^ ("0" and "1") as the realization of a stochastic process X and 
states of B (after copying) as the realization of stochastic process Y. The relationship 
between these two processes can be depicted by the graph in Figure 1. 
It is a complete analogy with the Shannon's, binary, noisy information channel. The 
process X correspond to the process at the entrance to the channel, the process Y in 
the output. 
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poo=1-b 




process X process Y 

(state of A) (state of B) 



Figure 1: Relation between the processes X and Y . The poo and pn - probabihty of 
correct transmission, poij Pw - probabihty of erroneous transmission 

In the next step, we calculate transinformtion I{X, Y) for these processes (i.e. the 
amount of knowledge about X which is contained in Y) : 

Hx.Y)^Y.nx..Y,)^o,^^^^^ (14) 

where the probabilities for the process X are given by: 

P{Xo)=vo P{Xi)=pi 
while for the process Y are in the form: 

P{Yo)^Po{l-b)+p,b P{Y,)=pob + p,{l-b) 
while the total probabilities: 

P{Xo,Yo) ^ Po{l - b) P{Xo,Y,)^pob 
P{Xi,Yo)=pib P{Xi,Yi)=pi{l-b) 

Let us calculate transinformation (jl4p for the case po — Pi — 51 since then in A, we 
have exactly the Ibit of information. Then: 

liX, y) = 1 + (1 - 6) log2(l ~b) + 61og2 b. (15) 

5 Medium as a system with two states of energy 

For simplicity, we assume that Ipm)^ = \0)b and lum)^ = \1)b- In addition, we 
assume that they are stationary states of the free hamiltonian of B. Otherwise, these 
states would evolve in time and reading of information (stored in them) at any moment 
of time would be difficult. Thus, let Eq and Ei denote energy of state |0) b and energy 
of the |1)b, respectively. 

Our main assumption is that before copying the system B was in contact with the 
thermostat at a temperature of T long enough to reach thermodynamic equilibrium. 
In practice, this is a natural assumption, since any real device works at a temperature 
different from the absolute zeroU 

Probability of filling the levels |0) and |1) at temperature T are respectively given by: 

^° ^ l + exp(-/3A) ' ^''^ 
_ cxp(-/3A) _ 
- l + exp(-/3A) 



^In practice, some systems may be in a quasiequilibrium state, while a state of full equilibrium is 
possible to achieve only after a very long time. However, this situation will not be considered here. 
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where A = Ei — Eq. 

It is worth notmg that b — Pi only for b G (0; ^). For /3A >> 1 error rate b is very 
low, while for /3 A — )> error rate b tends to i . The most important conclusion is that 
medium B in thermal equilibrium is useful for copying if the energies of the levels 
differ (ie. A ^ 0). Otherwise, Pq = Pi = 1/2 and (under considerations presented in 
Section 3) the medium is totally useless. 



6 Redundancy 

In order to copy useful information, when 6 7^ 0, we have to protect transmission 
against possible errors. To this end, we must encode useful information by adding a 
certain amount of control symbols. Let us denote the number of all symbols by n (one 
symbol carrying one bit of useful information and n — 1 symbols are control symbols). 
In practice, we should have not only one system A but the whole series of systems in an 
amount of n. We also need n systems B in the states corresponding to a temperature 
of T, where we finally put "dirty" copies from systems A. 

According to the Shannon theorem [6] , we can conclude that for transfer of one bit 
of useful information, n — I{X,Y)^^ bits are necessary, where I{X,Y) is given by 
formula ()15p . We do not examine here any specific coding procedure (the values that 
control bits must take are not defined). 



7 Calculations, graphs, conclusions 

Let us calculate the energy that must be used to copy n symbols from systems A to 
systems B. It is calculated as follows: 

W = n{E' - E) (18) 

where E — APi — A6 is the average energy of B before copying (i.e., at a temperature 
of T) calculated for E^ = b € (0; \). Energy E' = \A is the average energy 
of B after copying. We assume here that the probabilities of occurrence of zeros and 
ones in the B are equal and amount to 1/21^1 This gives the energy (fTSl) equal to: 

where b is given by Eq. (17). 

Energy (IT9|) is an increasing function of A. This means that it is less expensive to 
encode the information at low signal to noise ratio with a large amount of control 
symbols n. In the borderline case, we obtain: 

W^™„ = |hn W{P, A) - (20) 

Energy ([T9|) does not correspond to the scattered heat (as in Landauer). Our copy 
machine works reversibly. The copy obtained in the B still contains information about 
the state of medium B before copying. This information can be recovered by comparing 
the "dirty" copy with original one saved on A. Thus, there is no erasure of information. 
Erasure may occur in the next phase - on machine decoding and removing copying 
errors. 



^ This follows from the following facts: po = Pl = 5- In addition, we assume that among the 
control symbols added before copying is the same number of "0" and "1". This type of code are 
usually the most optimal. During copying from Ato B probability of distortion from "0" to "1" and 
from "1" to "0" are the same (Fig. 1). This results in conservation of symmetry between the zeros 
and ones on the B. 
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Figure 2: Energy used for copying one bit of useful information as function of A for 
^ = 1. The straight Une (added for comparison) corresponds to the value A/2. 
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